NUCLEAR SCIENCE AND TECHNIQUES 26, 060401 (2015) 


Event-driven timing system based on MRF cPCI hardware for HLS-II* 


LI Chuan (#)!|),’ WANG Ji-Gang (€F), XUAN Ke (EFH, LIU Gong-Fa (XH £), 


WANG Lin (3h), LI Wei-Min (X F), and LI Jing-Yi (E3 #)! 


National Synchrotron Radiation Laboratory, University of Science and Technology of China, Hefei 230029, China 
(Received February 15, 2015; accepted in revised form August 24, 2015; published online December 20, 2015) 


Hefei Light Source (HLS)-II is a vacuum ultraviole (VUV) synchrotron light source. A major upgrade of the 
light source was finished at the end of 2014. The timing system was rebuilt using compact peripheral component 
interconnect (cPCI) event-driven hardware to meet synchronization requirements of the machine. In the new 
system, the cPCI event-driven products manufactured by the micro-research finland (MRF) Oy are employed to 
achieve about 100 output signals with different interfaces. Device supports and drivers developed for common 
Experimental Physics and Industrial Control System (EPICS) records are used to access the registers on the 
timing modules. Five cPCI-bus input/output controllers (OCs) distributed in different areas of the light source 
host timing modules for various subsystems. The delay resolution of this system is 9.8 ns for most channels and 
9 ps for the channels used for triggering the electron gun and the injection kickers. The measured rms jitter of 
the output signal is less than 27 ps. Using the bucket chooser, this system enables the HLS-II to fill the storage 
ring with any designated bunch pattern. Benefitting from this upgrade, brightness and performance of the light 


source are significantly improved. 
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I. INTRODUCTION 


The Hefei Light Source (HLS) at National Synchrotron Ra- 
diation Laboratory is a second-generation synchrotron radia- 
tion light source, which provides radiations from IR to vac- 
uum ultraviole (VUV) for various user programs. It is com- 
prised of an 800 MeV linac, an 800 MeV storage ring and a 
transport line connecting the linac and storage ring. From 
2010 to 2014, it was upgraded into HLS-II [1-3] with im- 
proved brightness. The timing system was rebuilt to meet 
the synchronization requirements of the machine. It is de- 
signed based upon two considerations: 1) all trigger signal- 
s are phase-locked with the RF signal of the storage ring 
to ensure that an electron bunch from the electron gun can 
be correctly injected into a specified radio frequency (RF) 
bucket of the storage ring; and 2) the width, delay and other 
specifications of the output pulses can be independently ad- 
justed. The design specifications of the HLS-II timing system 
are listed in Table 1. 


TABLE 1. Design specification of the HLS-II timing system 


Specifications E-gun, Kicker Others 
Jitter (rms) < 100 ps — 
Delay resolution 10 ps 10 ns 
Maximum delay > 1s — 
Width resolution 20 ns — 
Maximum pulse width > 60 us — 


The HLS-II timing system provides about 100 output sig- 
nals to trigger accelerator subsystems, including the electron 
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gun, solid-state amplifiers, modulators, injection septum and 
kicker power supplies of the storage ring, etc. In addition, it 
provides RF and revolution frequency clocks for beam diag- 
nostic stations. The clocks are phase-locked with the storage 
ring RF system to ensure that the diagnostic devices work 
properly. 

In this paper, an overview on the timing system and its 
hardware integration is given first. The software developmen- 
t, control function realization, and test results of the system 
performance are then presented. 
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Fig. 1. Timing sequence of the HLS-II. The horizontal axis does not 
represent the real time scale. 


Il. SYSTEM OVERVIEW 


The HLS-II timing system guides various accelerator com- 
ponents to accelerate and inject electron bunches into desig- 
nated buckets of the storage ring properly. Figure | illustrates 
the timing sequence of the trigger signals for the accelerator 
components. The storage ring buckets are defined by the R- 
F system. To inject an electron bunch into a certain bucket, 
the electron gun is triggered with a proper delay with respec- 
t to the RF signal. Then the linac modulators are properly 
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Fig. 2. (Color online) Overview of the HLS-II timing system. 


triggered to provide RF power for accelerating the electrons. 
The injection devices, including the septum and kickers, are 
energized at the moment when an bunch of electrons arrives, 
and guide the electrons into the acceptance phase space of 
the storage ring. The delays of these accelerator units are de- 
termined by their locations, and the length of the cable/fibre 
transferring the timing signals. 

As the event-driven timing system developed by the micro- 
research finland (MRF) Oy is widely used in many accelera- 
tor facilities all over the world [4—10], the MRF cPCI-series 
products were chosen in designing the HLS-II timing sys- 
tem. The software of the HLS-II timing system was develope- 
d based upon the Experimental Physics and Industrial Control 
System (EPICS) [11]. A hardware schematic diagram of the 
system is shown in Fig. 2. The timing system employs an 
event generator (EVG) card, cPCI-EVG300 [12], as the mas- 
ter card to generate event codes. The RF signal with a fre- 
quency of 204 MHz is used as input signal for the EVG card, 
and for phased-lock with the RF system. The input signal 
passes through a divider in the EVG card, and is used as the 
event clock to generate event codes. The event codes are sent 
to all event receiver (EVR) cards installed in input/output con- 
trollers (IOCs) via a cPCI-FOUT12 fan-out card [13] hosted 
by the same IOC as the EVG card. Among the EVR card- 
s, CPCI-EVR300 cards are used to generate common trigger 
signals, while cPCI-EVRTG cards are used to generate trig- 
ger signals with fine delay tuning for the electron gun and 
injection kickers, and to reconstruct the RF and revolution 
frequency clocks for beam diagnostic stations. 

Five IOCs are distributed in different locations to provide 
trigger signals for nearby systems. Two IOCs are installed 
in the linac area for the linac related systems. The master 
IOC holding the cPCI-EVG300 and cPCI-FOUT12 cards is 
installed beside the RF signal generator of the storage ring. It 
is also used to provide trigger signal for the injection system. 
Besides, two IOCs with similar hardware are respectively in- 
stalled inside and outside of the storage ring, to produce RF 
and revolution frequency clocks for beam measurement appa- 
ratus. Each IOC of the timing system employs a cPCI-6880 
CPU board. Compact PCI chassises cPCIS-6418U manufac- 

tured by Adlink coporation are adopted to host the CPU board 


and MRF timing modules. The IOC software runs under Cen- 
tOS operating system. All the EPICS drivers, records and op- 
eration interfaces are stored in a virtualized server cluster, and 
shared by timing IOCs through NFS protocol [14]. 


Il. SOFTWARE DEVELOPMENT 


A. Device supports and drivers 


In EPICS-based control systems, a set of records are used 
to control and monitor a certain device. These records ac- 
cess the hardware via corresponding device supports and/or 
drivers. In developing software of the timing system, we used 
well developed records in the EPICS package, including ai, 
ao, bi, bo, mbbi and mbbo. Device supports were developed 
for the records to send/fetch data to/from the timing modules, 
and drivers were developed for interfacing the device supports 
and timing modules. 


The scheme proposed by Eric Bjorklund [15] is used 
for developing drivers of the timing modules. The 
driver software is developed in a modular structure 
for high flexibility and extensibility. For example, 
the driver module EVG_initialize(hdl,“evg dev_name”) and 
EVR initialize(hdl,“evr_dev_name’’) is used to initialize EVG 
and EVR cards installed in an IOC, respectively, with hdl be- 
ing the handle used for accessing the card by the drviers. The 
initialization procedures are configured in the start-up script 
st.cmd of each IOC and called during IOC booting up. Other 
driver modules can be called by device supports with particu- 
lar arguments to control the parameters of each channel, such 
as the pulse delay, pulse width, enable switch, polarity switch 
and trigger event, etc. 


The EPICS system selects an appropriate device support 
for a record according to the record’s DTYP field. The D- 
TYP field currently has two options, “MRF EVG” and “MRF 
EVR” for EVG and EVR cards, respectively. 
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Fig. 3. (Color online) Debug (up) and operational (down) interfaces of the HLS-II timing system. 


B. Records for the timing system 


In the timing system, two groups of records are used to 
fulfil different tasks. The first group of records are hardware 
oriented and used to directly control the timing modules. The 
other group of records are used to realize various control func- 
tions of the timing system. 


The hardware oriented records are named using the con- 
vention given by JOC:Card:Chan:Func. Each of the records 
is used to control and/or monitor the property Func of a chan- 
nel Chan on a timing module Card installed in JOC. Proper- 
ties of each channel are controlled by registers on the timing 
module. The hardware oriented records directly write/read 
corresponding registers via device driver. The value of field 
INP/OUT of a read/write record gives the address of the reg- 
ister. Both INP and OUT use the VME address convention, 
which is expressed as “#CxSy@para’. In this convention, 
x and y represent the card and channel numbers, respective- 
ly. The optional string in para is used to specify the to-be- 


controlled property of the channel, such as delay, width and 
polarity of the output pulse. Because of the large number 
of these types of records, we use templates to manage the 
records. However, the EPICS command dbLoadTemplate is 
inconvenient to be called with arguments. To solve this prob- 
lem, we develop a number of EPICS commands, such as d- 
bLoadEVR300 and dbLoadEVRTG, to load the record tem- 
plates during IOC starting up. The arguments are passed to 
the template loading commands using environment variables 
as following: 

epicsEnvSet( “MRF HOST”, “Host06”) 

epicsEnvSet(“MRF_CARD”, “0”’) 

< ${TOP}/iocBoot/${I1OC}/dbLoadEVR300 

epicsEnvSet(“MRF_CARD”, “1”) 

< ${TOP}/iocBoot/${IOC}/dbLoadEVR300 

epicsEnvSet(“MRF_CARD”, “2”) 

< ${TOP}/iocBoot/${I1OC}/dbLoadEVR300 

epicsEnvSet(“MRF_CARD”, “3”) 

< ${TOP}/iocBoot/${IOC }/dbLoadEVRTG_${MRF_HOST} 
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For realizing complicated control functions, a set 
of function oriented records are employed. These 


records use a different name convention given by Ma- 
chine_Device:Function:RecordType, where Machine can be 
SR or IJ, representing the storage ring and injector, respec- 
tively. Device is the subsystem which uses the timing signal, 
such as the injection kickers, the solid state amplifiers of the 
linac microwave system, etc. Function can be delay, width, 
switch or other properties of a synchronization pulse. Record- 
Type denotes the record type in use, which can be ai, ao, bi, 
bo, etc. The input or output links of these records point to 
corresponding hardware oriented records. 


C. User Interface 


Operator interfaces of the timing system are developed us- 
ing the Extensible Display Manager (EDM) [16]. Accord- 
ing to different purposes, the interfaces are divided into two 
groups. One is for hardware related records referred as the de- 
bug interfaces. This type of interface is used for troubleshoot- 
ing failures. The other is device-oriented interface used for 
routine operations. Examples of debug and operation inter- 
faces are shown in Fig. 3. 


IV. BUCKET-BY-BUCKET INJECTION 


Bucket-by-bucket injection is essential for stable opera- 
tion and critical for user programs. To realize this injection 
scheme, the HLS-II timing system is configured as shown in 
Fig. 4 to provide synchronization signals with proper delays 
for various systems. As the timing modules only work with 
a frequency low than 125 MHz, a frequency divider is used 
to acquire a 102 MHz signal from the 204 MHz input signal. 
This 102 MHz signal is used as the clock signals for the delay 
modules, and used as the input signal of a counter to produce 
the 1 Hz injection signal for the bucket chooser which is actu- 
ally a delay unit. Both the frequency divider and counter are 
inhabited in the EVG card. The clock and injection signals 
are also used by various beam diagnostic apparatus to syn- 
chronize their measurements. Using pre-programed delays, 
the bucket chooser produces signals to trigger the electron 
gun, linac power source system, and the storage ring injec- 
tion system to aim the electron beam at a designated bucket. 
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Fig. 4. (Color online) A functional diagram of the timing system. 
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Since the bucket chooser uses a 102 MHz signal as its 
clock, while the storage ring RF signal is 204 MHz, the de- 
lay time between two ticks of the bucket chooser equals to 
2 bucket length, i.e. the bucket chooser can aim an elec- 
tron bunch just at every other bucket. However, the harmonic 
number of the HLS-II storage ring is 45, the bucket-by-bucket 
injection can be accomplished using proper bucket chooser 
delays. The number of delay ticks for the n'" bucket is given 
by 

tn = n/2, (n = 0,2,4,...,44); i 
tn = 22 + (n + 1)/2, (n = 1,3,5,...,43). (1) 


This delay arrangement is illustrated in Fig. 5. Each bucket 
can be enabled/disabled to be filled as shown in the lower part 
of Fig. 3. The enabled buckets can be automatically iterated 
or changed manually during injection. 


Delay Offset 


Injection trigger 
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Fig. 5. Bucket-by-bucket injection delay arrangement. 


V. SYSTEM PERFORMANCE TEST 


An offline platform (Fig. 6) was setup to test the perfor- 
mance of the timing system. An EVR or EVRTG output sig- 
nal is connected to a Tektronix DPO5204 oscilloscope, which 


Fig. 6. (Color online) Offline test platform of the timing system. 
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Fig. 7. (Color online) Relative jittering between the EVR output and 
RF signal. 


TABLE 2. Jitter of the timing system in three 24 h-measurements. 


Measurements Pk-to-Pk (ps) STD (ps) 
#1 180.0 26.8 
#2 160.0 20.8 
#3 180.0 23.0 


has a 2 GHz bandwidth and up to 10 GHz sampling rate. The 
RF signal is connected to another input channel of the oscillo- 
scope. The delay resolution and stability of the timing signal 
are measured using the test platform. The EVR/EVRTG de- 
lay resolution is measured by varying the delay time of an 
output channel while using the RF signal as the trigger for 
the oscilloscope. The result shows that the delay resolution 
of the EVR is 9.8ns, and the EVRTG is 9ps. The stability 
is measured by taking the statistics of the zero voltage posi- 
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tion of the RF signal while using the EVR output signal as the 
oscilloscope’s trigger, as shown in Fig. 7. 

Three measurements were performed consecutively, with 
the duration of each measurement being about 24 hours. The 
results show that the relative jittering between the EVR out- 
put and the RF signal is close to a normal distribution, with 
a jitter width of less than 27 ps, and the maximum peak-to- 
peak value of about 180 ps, as shown in Table 2. These indi- 
cate that performance of the timing system meets the design 
specification. The timing system has performed nicely during 
one and half years of commissioning and operation of HLS- 
II. 


VI. CONCLUSION 


The HLS-II timing system is developed using the cPCI 
event-driven products manufactured by the MRF Oy. Com- 
mon records in the EPICS package are used to realize control 
functions of the timing system. To effectively control the tim- 
ing modules, device supports and drivers are developed to ma- 
nipulate various parameters of the timing modules. The op- 
eration interfaces are developed using EDM to fulfil different 
purposes. 

The timing system is capable of bucket-by-bucket injec- 
tion. By setting a proper delay to the bucket chooser, the 
storage ring can be filled with any designated bunch pattern. 
Offline tests and one and half years of commissioning and op- 
eration indicate that the timing system meets the requirement 
of the light source operation. 
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